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ABSTRACT:  A  theory-based  approach  for  research 
on  information  displays  m  computer-supported  deci- 
sion making  is  proposed.  Information  display  charac- 
teristics can  influence  the  decision  maker's  selection 
of  a  cognitive  strategy.  Since  the  effectiveness  of  deci- 
sion making  depends,  in  part,  on  the  strategy  selected, 
knowledge  about  the  display-strategy  relationship  can 
ultimately  improve  the  qualify  of  decision  support  by 
identifying  displays  that  encourage  the  selection  of 
effective  strategies.  Support  for  this  approach  is  pro- 
vided by  a  discussion  of  research  on  strategy  selection, 
focusing  on  the  cognitive  effort  and  accuracy  of  deci- 
sion strategies  as  components  of  a  cognitive  incentive 
system  for  decision  makers.  Relevant  empirical  re- 
search on  information  displays  ts  reviewed  and  related 
to  the  cognitive  cost-benefit  approach.  Methodological 
issues  and  proposed  directions  for  information  display 
research  are  discussed. 
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1      Introduction 

What  is  the  best  way  to  display  information 
to  decision  makers?  This  issue  is  increasingly 
important  because  of  the  computer's  abihty  to 
rapidly  store,  manipulate,  and  display  informa- 
tion. As  computers  become  common  tools  in 
a  widening  variety  of  decisions,  it  has  become 
clear  that  characteristics  of  the  computer  sys- 
tem itself  can  influence  the  process  of  decision 
making.  Researchers  have  proposed  that  the  in- 
formation display  is  an  essential  characteristic  of 
all  computer-based  decision  support  systems  and 
may  be  an  important  determinant  of  the  effec- 
tiveness of  those  systems  (DeSanctis,  1984;  Ives, 
1982;  Zachary,  1986). 

Previous  research  on  information  displays  has 
largely  been  experimental  in  nature.  Typically, 
subjects  perform  a  decision  making  task  using 
displays  that  differ  on  one  or  more  factors  re- 
lated to:  (1)  the  form  of  individual  data  items  in 
the  display,  (2)  the  organization  of  display  items 
in  relationship  to  each  other,  or  (3)  the  way  in 
which  information  is  arranged  across  multiple 
displays.  Table  1  hsts  examples  of  display  design 
issues  that  have  been  considered,  along  with  rep- 
resentative citations.  Dependent  variables  usu- 
ally include  some  measure  of  performance  qual- 
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ity  or  accuracy,  as  well  as  related  measures  like 
decision  confidence  or  satisfaction. 

While  this  has  been  an  important  and  ac- 
tive area  of  research,  clear  conclusions  about  the 
impact  of  information  displays  on  decision  pro- 
cesses or  the  advisability  of  different  display  op- 
tions have  been  slow  to  emerge  (Jarvenpaa  & 
Dickson,  1988;  Jarvenpaa,  Dickson,  k  DeSanc- 
tis,  1985).  These  authors  cite  several  potential 
causes  for  these  difficulties,  including  lack  of  un- 
derlying theory,  problems  with  measurement  re- 
liability and  validity,  inappropriate  research  de- 
signs, and  the  use  of  diverse  and  incompara- 
ble experimental  tasks  (Jarvenpaa  et  al.,  1985, 
pp.  142-145).  In  this  paper,  we  focus  on  the  first 
of  these  causes  by  proposing  a  cognitive  mech- 
anism that  accounts  for  the  impact  of  informa- 
tion displays  on  the  decision  maker's  selection  of 
a  strategy  for  accomplishing  the  task. 

The  remainder  of  this  paper  is  organized  as 
follows:  Section  2  describes  how  the  concept  of 
strategy  selection  can  be  used  to  explain  the  in- 
fluence of  information  displays  on  decision  pro- 
cesses. Section  3  reviews  empirical  evidence  on 
the  connection  between  information  displays  and 
strategy  selection.  Finally,  Section  4  discusses 
some  implications  for  research  design  and  mea- 
surement and  suggests  directions  for  future  re- 
search on  information  displays. 


2      Theoretical  Approach 

In  this  paper,  we  will  use  the  term  "decision 
making"  in  the  broadest  possible  sense:  Deci- 
sion making  takes  place  in  a  number  of  different 
situations  that  we  will  refer  to  as  task  environ- 
ments, namely  environments  linked  with  a  goal 
(or  task).  This  goal  or  task  defines  the  nature 
of  the  problem  confronting  the  individual  (see 
Newell  &  Simon,  1972,  ch.  3).  We  view  deci- 
sion making  as  encompassing  a  large  number  of 
possible  tasks,  including  (1)  choice  under  condi- 
tions of  either  certainty  or  uncertainty,  (2)  eval- 
uative judgment,  (3)  predictive  judgment,  and 


(4)  inferential  judgment  (see  Einhorn  L  Hoga- 
rth, 1981,  for  a  discussion  of  the  relationship  be- 
tween judgment  and  choice).  This  perspective 
emphasizes  the  importance  of  the  structure  of 
the  task  environment  and  its  influence  on  the 
information  processing  strategies  that  individu- 
als use  to  accomplish  the  task.  A  strategy  is 
a  sequence  of  information  processes  that  is  in- 
tended to  achieve  the  goal.  In  general,  there 
are  many  possible  strategies  for  performing  any 
given  task.  Further,  the  set  of  strategies  avail- 
able for  one  task  is  generally  different  than  that 
for  another  task.  For  example,  strategies  used 
for  evaluative  judgment  have  been  found  to  differ 
substantially  from  those  used  for  choice  (Schkade 
k  Johnson,  in  press;  Tversky,  Slovic,  k  Kahne- 
man,  in  press). 

Research  on  decision  making  has  emphasized 
the  adaptive  interaction  of  the  decision  maker 
with  the  task  environment:  Decision  makers  use 
many  different  information  processing  strategies 
(e.g.,  Svenson,  1979)  and  adapt  to  changes  in 
the  task  environment  by  switching  strategies 
(Payne,  1982).  One  explanation  for  this  behav- 
ior is  that  decision  makers  engage  in  a  form  of 
cognitive  cost-benefit  analysis:  Strategy'  selec- 
tion is  the  product  of  a  trade-off  between  var- 
ious positive  and  negative  dimensions  of  alter- 
native strategies  for  a  task.  Different  strate- 
gies are  selected  in  response  to  changing  task 
characteristics  if  the  values  of  these  strategy  di- 
mensions change.  A  generalization  of  this  cost- 
benefit  view  is  to  formulate  the  strategv'  selection 
process  as  a  metadecision  problem,  in  which  one 
"decides  how  to  choose"  (Einhorn  k  Hogarth, 
1981,  p.  69).  Thus,  each  decision  strategy  can 
be  viewed  as  a  multidimensional  object,  with  the 
dimensions  corresponding  to  the  associated  costs 
and  benefits. 

Our  approach  focuses  on  two  particular  di- 
mensions of  strategies:  (1)  the  cognitive  effort 
required  to  use  a  strategy,  and  (2)  the  ability 
of  a  strategy  to  produce  an  accurate  ("correct") 
response.  Strategy  selection  can  be  analyzed  as 
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Table  1:  Some  Display  Design  Issues 

•  Should  information  be  presented  as  numbers  or  words?  Bell,  1984;  Huber,  1980;  Stone 
&  Schkade,  1989;  Wallsten  et  aJ.,  1986 

•  Should  information  be  presented  in  tables  or  graphs?  Benbasat  k.  Dexter,  1985, 
1986;  Benbasat,  Dexter,  k  Todd,  1986a,  1986b;  Benbasat  k  Schroeder,  1977;  Carter,  1947; 
DeSanctis  k  Jarvenpaa,  1987;  Dickson,  DeSanctis,  k  McBride,  1986;  Feliciano,  Powers,  k 
Bryant,  1963;  Ghani  k  Lusk,  1982;  Grace,  1966;  Lucas,  1981;  Lucas  k  Nielsen,  1980;  Lusk 
k  Kersnick,  1979;  Painton  k  Gentry,  1985;  Phelps  k  Shanteau,  1978;  Powers  et  al..  1984; 
Remus,  1984,  1987;  Tullis,  1981;  Umanath  k  Scamell,  1988;  Vernon,  1946;  Washburne,  1927; 
Watson  k  Driver,  1983;  Zmud,  1978;  Zmud,  Blocher,  k  Moffie,  1983 

•  If  graphical  representations  are  chosen,  what  type  should  they  be  and  what  em- 
bellishments should  be  incorporated?  Cleveland  k  McGill,  1984;  Croxton  k  Stein,  1932; 
Croxton  k  Stryker,  1927;  Keller,  1985;  MacGregor  k  Slovic,  1986;  Simkin  k  Hastie.  1987; 
Schutz,  1961a,  1961b;  Tversky  k  Gati,  1982;  Washburne,  1927 

•  How  should  color,   highlighting,   underlining,  or  other  display  features  be  used? 

Benbasat  k  Dexter,  1985,  1986;  Benbasat,  Dexter,  k  Todd,  1986a,  1986b;  Tullis,  1981 

•  Is  the  order  of  presentation  important?  Einhorn  k  Hogarth,  1985;  Russo  k  Rosen,  1975 

•  What  information  should  be  presented  so  that  it  will  be  read  first?  Plott  k  Levine, 
1978;  Tversky  k  Sattath,  1979 

•  Should  information  be  presented  simultaneously  or  in  sequence?  Bettman  k  Kakkar, 
1977;  Bettman  k  Zins,  1979;  Biehal  k  Chakravarti,  1982;  Russo,  1977;  Russo,  Krieser,  k 
Miyashita,  1975;  Russo  et  al.,  1986 

•  Should  information  on  different  displays  be  presented  in  standardized  or  unstan- 
dardized  formats?  Bettman,  Payne,  k  Staelin,  1986 
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the  product  of  a  trade-off  between  the  desire  to 
maximize  the  likelihood  of  producing  a  correct 
decision  and  the  desire  to  minimize  the  expen- 
diture of  cognitive  resources.  In  this  section,  we 
first  discuss  the  roles  of  effort  and  accuracy  in 
strategy  selection,  and  then  propose  that  these 
concepts  can  be  used  to  analyze  the  impact  of  in- 
formation display  options  on  strategy  selection. 

2.1      Effort  and   Accuracy  in   Strategy 
Selection 

Accuracy  has  typically  been  defined  relative 
to  a  criterion  such  as  a  normatively  appro- 
priate (optimal)  response  or  some  other  rel- 
evant benchmark  (Einhorn  &  Hogarth,  1981, 
pp.  55-61;  Hogarth,  1981;  March,  1978;  Si- 
mon, 1978).  Effort  has  typically  been  defined 
as  the  total  expenditure  of  cognitive  resources 
required  to  complete  the  task,  as  reflected  by 
measures  like  total  decision  time  or  total  num- 
ber of  cognitive  operations  (Johnson,  1979;  Kah- 
neman,  1973;  Russo  &  Dosher,  1983).  Since 
both  the  accuracy  and  effort  associated  with  a 
strategy  may  vary  with  changes  in  task  char- 
acteristics, different  strategies  will  provide  the 
best  trade-off  in  different  situations  (Beach  & 
Mitchell,  1978;  Bettman,  Johnson,  &  Payne,  in 
press;  Christensen-Szalanski,  1978,  1980;  John- 
son, 1979;  Johnson  &  Payne,  1985;  Klayman, 
1983;  Payne,  1976;  Payne,  Bettman,  t  John- 
son. 1988;  Russo  k  Dosher,  1983;  Shugan,  1980; 
Thorngate,  1980;  Wright,  1975).  Factors  other 
than  accuracy  and  effort  may  also  influence 
strategy  selection  (e.g.,  justifiability,  awareness 
of  conflict;  see  Beach  &  Mitchell,  1978). 

Accuracy  and  related  concepts,  such  as  de- 
cision quality,  have  a  well  established  place  in 
the  study  of  decision  making.  In  contrast,  while 
cognitive  effort  has  played  an  important  role 
in  other  areas  of  cognitive  psychology,  it  has 
only  recently  been  introduced  to  decision  mak- 
ing research.  Concepts  like  reduction  of  cog- 
nitive strain  and  conservation  of  cognitive  re- 
sources have  been  used  to  account  for  perfor- 


mance in  simple  cognitive  tasks  like  concept  for- 
mation (Bruner,  Goodnow,  h  Austin,  1956), 
mental  arithmetic  (Dansereau,  1969),  and  selec- 
tive attention  (Kahneman,  1973).  These  con- 
cepts have  been  extended  to  more  complex  tasks 
like  problem  solving  (Newell  &  Simon,  1972;  Si- 
mon Sz  Hayes,  1976)  and,  recently,  decision  mak- 
ing (Payne,  1982).  Seemingly  minor  variations 
in  characteristics  of  task  environments  can  lead 
to  dramatic  variations  in  the  time  required  to  use 
a  particular  strategy.  For  instance,  Dansereau 
(1969)  found  that  completion  times  in  a  simple 
mental  arithmetic  task  can  vary  by  a  factor  of 
as  much  as  100  across  apparently  similar  prob- 
lems. In  a  more  complex  problem  solving  task, 
Kotovsky,  Hayes,  and  Simon  (1985)  found  that 
completion  times  for  isomorphic  versions  of  the 
same  problem  can  vary  by  a  factor  of  as  much 
as  16. 

Although  this  is  a  relatively  new  area  for  deci- 
sion making  research,  the  existing  empirical  ev- 
idence on  strategj'  selection  can  be  summarized 
by  several  working  assumptions  about  the  roles 
of  effort  and  accuracy.  Five  assumptions  will  be 
discussed  in  turn: 

Working  Assumption  1:  The  effort  and  accu- 
racy associated  with  various  strategies  are  un- 
certain quantities  and  must  be  estimated  by  de- 
cision makers.  Strategy  selection  is  a  subjective 
process,  based  upon  a  decision  maker's  percep- 
tions of  effort  and  accuracy  (Beach  and  Mitchell, 
1978).  One  source  of  uncertainty  may  be  unpre- 
dictability or  ambiguity  in  the  task  environment. 
Limitations  in  the  decision  maker's  knowledge  or 
experience  may  also  contribute.  This  problem  is 
likely  to  be  most  pronounced  when  the  task  is 
unfamiliar  or  after  unexpected  changes  in  the 
ta^k  environment  have  occurred.  Thus,  strategy 
selection  depends  upon  anticipated  effort  and  ac- 
curacy. 

Working  Assumption  2:  Decision  makers  are 
generally  better  at  estimating  effort  than  accu- 
racy. It  is  not  surprising  that  decision  mak- 
ers often  have  difliculty  learning  about  accuracy, 
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since  many  environments  provide  outcome  feed- 
back that  is  incomplete,  ambiguous,  and  subject 
to  long  delays  (Einhorn,  1980;  Einhorn  k  Hoga- 
rth, 1978).  Learning  about  accuracy  can  even  be 
difficult  in  the  presence  of  complete  and  accurate 
outcome  feedback  (Brehmer,  1980).  Johnson 
and  Payne  (1985)  suggest  that  decision  makers' 
self-knowledge  concerning  cognitive  processes  is 
likely  to  be  much  more  complete  with  respect  to 
effort  than  accuracy,  since  feedback  about  the 
ease  with  which  the  decision  process  was  im- 
plemented is  usually  more  immediate  and  read- 
ily interpretable  than  outcome  feedback.  Fur- 
thermore, since  the  criteria  for  accuracy  can 
vary  widely  across  different  decisions,  it  may  be 
difficult  to  accumulate  comparable  experiences 
about  the  accuracy  of  a  given  strategy.  On  the 
other  hand,  cognitive  effort  is  probably  easier 
to  compare  across  decisions,  because  the  subjec- 
tive experience  of  expending  cognitive  resources 
(e.g.,  as  reflected  in  the  time  required  to  make 
a  decision)  is  similar  from  one  task  environment 
to  the  next. 

Working  Assumption  3:  The  nature  of  the 
trade-off  between  accuracy  and  effort  is  sensitive 
to  the  values  of  the  decision  maker  and  char- 
acteristics of  the  task  environment.  Evidence 
clearly  indicates  that  strategy  selection  is  sen- 
sitive to  considerations  of  both  accuracy  and 
effort  (Payne  et  al.,  1988).  However,  there  is 
also  evidence  to  suggest  that  decision  makers 
place  relatively  greater  emphasis  on  minimiz- 
ing effort  than  on  maximizing  accuracy  (e.g., 
Russo  &  Dosher,  1983).  This  emphasis  could  be 
due  in  part  to  the  greater  availability  of  knowl- 
edge about  effort,  mentioned  above  (i.e.,  decision 
makers  pay  more  attention  to  effort  because  they 
know  more  about  it).  The  trade-off  between  ef- 
fort and  accuracy  may  simply  reflect  the  pay- 
off structure  in  the  environment:  In  some  sit- 
uations, errors  are  perceived  to  be  very  costly 
(e.g.,  medical  diagnosis),  while  in  others,  they 
are  not  (e.g.,  purchasing  coffee).  Thus,  a  de- 
cision maker's  willingness  to  expend  additional 


cognitive  effort  will  depend  on  the  size  of  the  per- 
ceived benefit  to  be  derived  from  fewer  errors. 

Differences  in  the  relative  emphasis  placed  on 
effort  and  accuracy  may  also  reflect  the  fact 
that  in  many  tasks,  either  accuracy  or  effort  is 
relatively  insensitive  to  the  choice  of  strategy. 
For  instance,  in  very  complex  dynamic  decision 
making  tasks,  simple  strategies  often  provide 
good  approximations  to  the  accuracy  of  opti- 
mal strategies  while  conserving  effort  (Hogarth, 
1981;  Kleinmuntz,  1985).  In  situations  where 
strategies  have  uniformly  high  accuracy,  effort 
considerations  are  likely  to  have  greater  impact 
on  strategy  selection.  The  opposite  effect  might 
be  expected  in  very  simple  tasks,  where  addi- 
tional effort  required  to  implement  very  accurate 
strategies  may  be  a  minor  consideration  (Payne, 
1976).  When  effort  is  uniformly  low,  accuracy 
considerations  should  loom  larger.  Thus,  effort 
or  accuracy  will  influence  strategy  selection  only 
to  the  extent  that  one  or  the  other  differs  across 
strategies. 

Working  Assumption  4-  ^"  some  circum- 
stances, human  information  processing  limita- 
tions can  make  some  strategies  infeasible.  Pro- 
cessing limitations  are  caused  by  the  small  ca- 
pacity of  short-term  memory  and  the  serial  na- 
ture of  information  processing  operations  (Si- 
mon, 1981,  ch.  2).  Tasks  of  sufficient  complexity 
may  overwhelm  these  limited  capabilities.  For 
example,  if  a  choice  problem  involves  a  large 
number  of  alternatives  and  attributes,  relatively 
simple  strategies  may  be  adopted  not  out  of 
choice,  but  out  of  necessity  (Payne,  1976).  Simi- 
larly, if  the  decision  must  be  made  under  time 
pressure,  some  strategies  may  not  be  able  to 
reach  a  decision  within  the  allotted  time  (Payne 
et  al.,  1988;  Wright,  1974).  In  circumstances 
such  as  these,  the  upper  bound  on  effort  consti- 
tutes a  constraint  that  must  be  satisfied  irrespec- 
tive of  other  dimensions  of  a  decision  strategy. 

Working  Assumption  5:  The  decision  maker's 
knowledge  and  expertise  influences  strategy  se- 
lection.   One  could  assume  that  decision  mak- 
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ers  have  a  broad  repertoire  of  standard  decision 
strategies,  and  that  strategy  selection  is  merely 
a  matter  of  determining  which  strategy  happens 
to  provide  the  best  trade-off  of  anticipated  ef- 
fort and  accuracy.  Evidence  on  problem  solving 
supports  the  notion  that  expert  decision  mak- 
ers adaptively  select  strategies  in  this  fashion 
(Larkin,  McDermott,  Simon,  &  Simon,  1980). 
However,  in  unfamiliar  tasks,  a  decision  maker's 
knowledge  about  strategies  may  be  limited  and 
only  a  subset  of  the  available  strategies  consid- 
ered (e.g.,  Kleinmuntz  &  Thomas,  1987).  An- 
other possibility  is  that  the  decision  maker  con- 
structs new  strategies  as  they  are  needed  (J. 
Anderson,  1985,  pp.  225-228;  Luchins,  1942). 
Whether  the  end  result  of  this  process  of  con- 
structing and  testing  strategies  is  consistent  with 
the  notion  of  trading  off  effort  and  accuracy  is 
still  very  much  an  open  question  (for  some  inter- 
esting speculations,  see  Payne  et  aJ.,  1988). 

Our  theoretical  understanding  of  strategy  se- 
lection is  still  being  developed  and  modified. 
Some  empirical  findings  on  task  effects  have  not 
yet  been  accounted  for  by  this  approach.  For 
instance,  Payne  (1982)  describes  several  exper- 
iments in  which  decision  makers'  responses  to 
variations  in  problem  presentation  seem  to  be 
governed  by  basic  principles  of  human  percep- 
tion rather  than  cost-benefit  considerations.  The 
best  known  phenomena  of  this  type  involve  the 
shifts  in  preferences  that  are  observed  when  the 
same  problem  is  framed  in  different  ways  (Tver- 
sky  &  Kahneman,  1981;  also  see  Kahneman  & 
Tversky,  1979;  Thaler,  1980,  1985).  However,  a 
cost-benefit  approach  appears  capable  of  analy- 
sis and  prediction  of  strategy  selection  across  a 
variety  of  decision  making  situations.  In  par- 
ticular, effort  and  accuracy  have  emerged  as 
keys  to  understanding  the  relationship  between 
task  characteristics  and  the  selection  of  decision 
strategies.  Although  a  number  of  other  factors 
can  and  do  influence  strategy  selection,  the  way 
in  which  effort  and  accuracy  change  in  response 
to  variations  in  the  task  environment  is  crucial. 


2.2     Information    Displays    and    Strat- 
egy Selection 

While  many  different  characteristics  of  task  envi- 
ronments can  influence  strategy  selection,  the  in- 
formation display  deserves  particular  attention. 
The  designer  may  have  little  or  no  control  over 
other  task  characteristics,  but  the  display  op- 
tions can  be  directly  controlled.  In  contrast,  the 
decision  maker  directly  controls  only  the  selec- 
tion of  strategy,  while  the  display  options,  task 
characteristics,  and  even  the  decision  maker's 
own  knowledge  are  predetermined.  Thus,  the 
system  designer  can  exert  indirect  control  over 
strategy  selection  through  direct  control  of  dis- 
play options. 

A  simple  yet  compelling  demonstration  of  this 
indirect  control  was  provided  by  Russo  (1977), 
who  was  able  to  induce  changes  in  purchase  pat- 
terns in  a  supermarket  through  a  simple  reor- 
ganization of  the  display  of  product  informa- 
tion. Specifically,  he  gathered  unit  price  in- 
formation on  a  single  list  that  permitted  shop- 
pers to  make  less  effortful  comparisons  than 
were  possible  while  walking  down  the  supermar- 
ket aisle.  The  observed  result  was  a  significant 
shift  in  purchases  to  products  with  lower  unit 
prices.  Although  Russo's  experiment  did  not 
use  computer-based  information  displays,  one 
can  easily  imagine  a  similar  situation  in  which 
consumers  could  obtain  product  information  en- 
tirely from  a  computer.  In  fact,  product  infor- 
mation may  soon  be  routinely  obtained  from  dis- 
tributed databases  and  actual  purchase  decisions 
based  in  whole  or  in  part  on  information  derived 
from  computer  displays  (e.g.,  via  networks  such 
as  CompuServe). 

A  number  of  other  studies,  reviewed  in  the 
next  section,  also  suggest  that  differences  in 
the  information  display  influence  strategy  se- 
lection because  of  changes  in  either  the  effort 
or  the  accuracy  with  which  various  informa- 
tion processing  activities  can  be  accomplished. 
Together  with  task  characteristics  and  decision 
maker  knowledge,  the  information  display  im- 
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plicitly  defines  a  cognitive  incentive  system  for 
decision  makers,  comprising  the  cost-benefit  di- 
mensions discussed  above.  Specifically,  diflfer- 
ences  in  displays,  task  characteristics,  and  de- 
cision maker  knowledge  change  the  anticipated 
effort  and  accuracy  of  each  available  strategy 
and,  therefore,  provide  an  incentive  for  decision 
makers  to  use  different  strategies  (see  Figure  1). 
Presumably,  a  major  source  of  decision  maker 
knowledge  is  learning  from  previous  experience, 
so  that  the  experienced  effort  and  accuracy  of 
past  decisions  will  influence  subsequent  antici- 
pations. 

How  do  differences  in  displays  influence  strat- 
egy selection?  One  way  to  think  about  this  is  to 
decompose  strategies  into  sequences  of  simpler 
substrategies  and  then  analyze  the  effects  of  dis- 
plays on  these  components.  For  example,  sub- 
strategies  can  be  associated  with  distinct  stages 
of  the  decision  making  process  (e.g.,  informa- 
tion acquisition  or  evaluation;  Simon,  1977),  or 
more  elementary  cognitive  operations  (e.g.,  mul- 
tiplication, comparison,  retrieval  from  memory; 
Chase,  1978).  We  propose  that  the  influence  of 
display  options  on  a  strategy's  effort  and  accu- 
racy is  the  aggregate  of  the  influences  on  each 
component  substrategies'  effort  and  accuracy. 

To  illustrate  how  differences  in  displays  can  in- 
fluence a  single  substrategy  or  operation,  imag- 
ine a  decision  maker  who  must  choose  a  new 
computer  system  from  a  set  of  available  alter- 
natives. Each  system  is  characterized  by  a  set  of 
features  (e.g.,  price,  ease  of  use,  expandability, 
and  speed).  First,  suppose  that  the  information 
can  be  presented  either  one  system  at  a  time 
(i.e.,  the  values  of  all  features  for  a  single  system 
on  the  same  screen)  or  one  feature  at  a  time  (i.e., 
each  screen  contains  the  values  of  one  feature  for 
all  systems).  Consider  a  common  substrategy 
like  comparing  the  values  of  two  systems  on  the 
same  feature.  The  first  type  of  display,  organized 
around  systems,  does  not  present  the  two  values 
simultaneously.  This  means  that  a  comparison 
of  this  type  will  be  more  effortful  than  a  com- 


parison made  with  the  second  type  of  display, 
organized  around  features,  in  which  the  two  val- 
ues are  displayed  simultaneously  (e.g.,  Bettman 
k  Kakkar,  1977). 

Now  suppose  that  the  system  features  can  be 
presented  either  in  a  tabular  display  of  numbers 
or  in  a  set  of  graphical  displays,  like  bar  charts. 
Another  common  operation,  reading  the  value  of 
a  particular  feature  for  a  particular  system,  can 
be  accomplished  with  a  relatively  small  chance 
of  error  when  the  information  is  presented  in  a 
table  of  numbers.  In  contrast,  extracting  a  spe- 
cific value  from  a  bar  chart  is  a  more  error-prone 
procedure  because  the  decision  maker  must  vi- 
sually project  the  height  of  the  appropriate  bar 
onto  the  chart's  scale  (Simkin  &  Hastie,  1987). 
Thus,  the  accuracy  of  this  substrategy  will  prob- 
ably be  lower  for  this  type  of  graphical  display. 

The  influence  of  display  differences  on  the  ef- 
fort and  accuracy  of  substrategies  is  important 
because  strategies  make  use  of  particular  sub- 
strategies  to  differing  degrees.  For  instance, 
some  strategies  for  choice  require  many  compar- 
isons across  systems  (e.g.,  majority  of  confirm- 
ing dimensions  or  additive  difference  strategies) 
while  there  are  other  strategies  that  do  few  if 
any  comparisons  of  this  type  (e.g.,  conjunctive  or 
weighted  additive  strategies;  see  Svenson,  1979). 
Thus,  changing  displays  in  a  way  that  makes  this 
type  of  comparison  easier  would  decrease  the  ef- 
fort required  for  the  former  strategies  more  than 
for  the  latter.  Similarly,  choice  strategies  that 
use  numerical  calculations  require  many  value 
extractions  (e.g.,  weighted  additive  strategy), 
while  many  other  strategies  do  not  (e.g.,  the  ma- 
jority of  confirming  dimensions  strategy  requires 
no  value  extractions,  while  the  elimination-by- 
aspects  strategy  requires  a  relatively  small  num- 
ber of  extractions).  Thus,  changing  to  a  dis- 
play that  makes  value  extractions  less  accurate 
would  affect  the  accuracy  of  the  weighted  addi- 
tive strategy  more  than  the  others. 

It  is  important  to  note  that  these  effects  will 
not  exist  in  isolation.  For  instance,  a  single  dis- 
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Figure  1:  Overview  of  the  Strategy  Section  Process 
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play  change  may  influence  both  the  accuracy  and 
effort  associated  with  a  substrategy — value  ex- 
traction from  bar  charts  may  be  both  less  ac- 
curate and  more  effortful  than  from  tabular  dis- 
plays (e.g.,  Carter,  1947).  Furthermore,  the  sup- 
port a  given  display  provides  to  one  substrategy 
or  operation  may  be  offset  by  the  impact  on  an- 
other substrategy  or  operation:  Switching  from 
a  table  to  a  bar  chart  may  make  value  extrac- 
tions more  difficult  and  less  accurate,  but  on  the 
other  hand,  recognizing  trends  or  doing  compar- 
isons may  become  easier  and  more  accurate  (e.g., 
Vessey  &  GaUetta,  1988).  Thus,  the  impact  of 
a  particular  display  on  a  particular  strategy  is 
the  product  of  the  aggregate  influence  on  all  the 
component  substrategies. 

The  effort-accuracy  approach  assumes  that 
decision  makers  have  learned  over  time  about  the 
aggregate  effects  of  varying  task  characteristics 
on  effort  and  accuracy.  As  display  options  are 
varied,  the  hypothesis  is  that  the  decision  maker 
will  adaptively  choose  strategies  that  are  rela- 
tively efficient  in  terms  of  anticipated  effort  and 
accuracy  (Payne  et  al.,  1988,  p.  550).  To  illus- 
trate, consider  the  anticipated  accuracy  and  ef- 
fort of  four  hypothetical  strategies  with  two  dif- 
ferent displays,  shown  in  Figure  2.  For  instance, 
the  points  A  and  A'  mark  the  accuracy  and  ef- 
fort of  the  same  strategy  for  the  two  different  dis- 
plays. Here,  anticipated  accuracy  is  scaled  rel- 
ative to  the  accuracy  levels  of  optimal  and  ran- 
dom baseline  strategies  (e.g.,  utility  maximiza- 
tion and  random  choice;  adapted  from  Johnson 
&  Payne,  1985).  Similarly,  anticipated  effort  is 
scaled  relative  to  the  effort  levels  required  to  im- 
plement the  two  benchmarks,  with  values  plot- 
ted from  most  to  least  effortful. 

Note  that  for  display  1,  strategy  A  dominates 
strategy  B,  achieving  a  higher  degree  of  accuracy 
while  requiring  less  effort.  However,  for  display 
2,  A  no  longer  dominates  B — although  B  is  still 
less  accurate  than  A,  it  is  now  less  effortful  as 
well.  More  generally,  for  a  particular  display, 
strategies  can  be  classified  into  two  groups,  dom- 


inated and  nondominated.  The  nondominated 
strategies  define  a  set  of  efficient  alternatives — 
within  this  efficient  set,  increased  accuracy  can 
only  be  achieved  by  selecting  a  more  effort- 
ful strategy,  while  reduced  effort  can  only  be 
achieved  by  selecting  a  less  accurate  strategy. 
Thus,  under  display  1,  a  decision  maker  who  be- 
lieves minimizing  effort  is  more  important  than 
maximizing  accuracy  might  prefer  strategy  C, 
while  a  decision  maker  who  places  more  empha- 
sis on  accuracy  might  select  strategy  A.  The 
composition  of  this  efficient  set  will  not  neces-  . 
sarily  be  the  same  for  different  displays  (e.g.,  the 
efficient  set  {A,C}  for  display  1  versus  {A',J5'} 
for  display  2).  Thus,  the  relative  attractive- 
ness of  various  decision  strategies  depends  on 
the  display,  and  decision  makers  should  adapt  to 
changes  in  displays  by  selecting  different  strate- 
gies. 

Some  authors  have  suggested  that  an  appro- 
priate display  is  one  that  "fits"  the  task  (Ben- 
basat.  Dexter,  &  Todd,  1986b;  DeSanctis,  1984; 
Jarvenpaa  &  Dickson,  1988;  Jarvenpaa  et  al., 
1985;  Vessey,  1988).  For  instance,  a  graphical 
display  might  be  appropriate  for  a  pattern  recog- 
nition task  (e.g.,  detecting  a  trend),  but  inappro- 
priate for  a  point-reading  task  (e.g,  retrieving  a 
specific  value).  These  authors  treat  both  task 
and  display  as  independent  variables  and  dis- 
cuss the  effect  of  matches  or  mismatches  between 
them.  Our  analysis  differs  in  an  important  re- 
spect: We  assume  that  the  task  is  held  constant 
while  treating  the  display  and  other  task  char- 
acteristics as  independent  variables.  However, 
these  two  approaches  are  not  necessarily  incom- 
patible: A  display  will  "fit"  a  task  to  the  extent 
that  the  efficient  strategies  for  the  task  use  sub- 
strategies  that  are  supported  by  the  display. 


3      Empirical  Evidence 

What  is  the  empirical  evidence  on  the  role  of  ef- 
fort and  accuracy  in  determining  the  connection 
between  display  options  and  strategy  selection? 
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The  existing  literature  on  information  displays  is 
large  and  varied.  Of  necessity,  we  focus  our  re- 
view on  those  studies  that  are  directly  relevant 
to  our  arguments.  More  comprehensive  reviews 
can  be  found  elsewhere  (e.g.,  Bettman,  Payne, 
Sz  Staelin,  1986;  DeSanctis,  1984;  Jarvenpaa  ^ 
Dickson,  1988). 

Our  discussion  in  the  previous  section  suggests 
that  there  ought  to  be  a  relationship  between 
display  options  and  the  variables  shown  in  Fig- 
ure 1,  and  that  this  relationship  ought  to  be  con- 
sistent with  the  cognitive  incentives  argument 
proposed  above.  Our  discussion  of  the  literature 
is  organized  around  three  categories  of  evidence: 
The  influence  of  display  options  on  (1)  measures 
of  anticipated  effort  and  accuracy,  (2)  measures 
of  experienced  effort  and  accuracy,  and  (3)  ob- 
servations of  actual  strategy  selection.  We  wiU 
discuss  each  of  these  in  turn. 

3.1      Anticipated  Effort  and  Accuracy 

Ideally,  to  study  the  effects  of  display  options 
on  anticipated  cognitive  incentives  we  would  like 
to  have  measures  of  a  decision  maker's  a  priori 
estimates  of  the  effort  and  accuracy  associated 
with  various  strategies.  Unfortunately,  we  have 
not  been  able  to  find  any  experiments  in  which 
displays  were  varied  and  decision  makers  were 
asked  to  assess  effort  or  accuracy  prior  to  engag- 
ing in  decision  making.  However,  the  influence 
of  display  on  perceptions  of  effort  and  accuracy 
may  be  reflected  indirectly  in  other  measures. 
Two  such  measures  are:  (1)  stated  preferences 
for  one  display  over  another,  and  (2)  estimates  of 
perceived  effort  or  perceived  accuracy  obtained 
after  a  task  has  been  completed. 

Vessey  and  GaUetta  (1988)  asked  decision 
makers  to  express  preferences  for  displays  be- 
fore attempting  a  task.  They  told  subjects  that 
they  would  have  to  perform  one  of  two  tasks,  ei- 
ther retrieval  of  a  specified  item  or  comparison 
of  items  to  be  obtained  from  a  display.  Subjects 
were  then  asked  whether  they  preferred  to  use 
a  table  of  numbers  or  a  graph  for  their  assigned 


task.  Subjects  given  the  fact  retrieval  task  pre- 
ferred a  table,  while  those  given  the  comparison 
task  preferred  a  graph.  Further,  the  subjects 
were  told  in  the  initial  instructions  that  although 
accuracy  was  relevant,  speed  was  the  primary 
goal.  If  the  subjects  responded  to  these  instruc- 
tions, then  the  difference  in  display  preferences 
for  the  two  tasks  reflect  the  subjects'  expectation 
that  ease  of  processing  for  each  task  would  be  in- 
fluenced by  the  nature  of  the  display.  Note  that 
while  the  actual  tasks,  reading  an  item  or  com- 
paring items,  were  quite  simple,  they  are  also 
important  component  operations  of  strategies  in 
more  complicated  tasks. 

Display  preferences  assessed  after  task  com- 
pletion may  also  reflect  anticipated  cognitive  in- 
centives, since  perceptions  of  effort  and  accu- 
racy from  previous  experiences  with  displays  and 
tasks  should  form  the  basis  for  subsequent  an- 
ticipations. In  two  studies  that  compared  dif- 
ferent types  of  graphs,  Schutz  (1961a,  1961b) 
used  a  task  that  required  subjects  to  identify 
trends  and  patterns  in  time-series  data.  Pref- 
erences for  displays  were  highly  correlated  with 
processing  speed:  Subjects  preferred  those  dis- 
plays in  which  judgments  had  been  arrived  at 
more  quickly.  In  the  first  study  actual  task  com- 
pletion time  and  accuracy  were  also  highly  cor- 
related, so  this  preference  could  be  interpreted 
in  terms  of  perceptions  of  effort,  accuracy,  or 
a  combination  of  both.  However,  in  the  sec- 
ond study,  the  task  was  relatively  easy  and  per- 
formance was  uniformly  good  across  displays  (a 
ceiling  effect).  Thus,  this  preference  appears  to 
reflect  perceived  effort  more  than  perceived  ac- 
curacy. 

Many  studies  of  information  displays  have  col- 
lected data  on  decision  makers'  level  of  confi- 
dence following  a  decision  because  confidence  is 
thought  to  be  closely  related  to  perceptions  of 
accuracy.  There  is  some  evidence  that  decision 
confidence  varies  with  display.  Using  a  fore- 
casting task,  DeSanctis  and  Jarvenpaa  (1987) 
found  that  subjects  were  most   confident  with 
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a  combined  graphical-tabular  display,  less  con- 
fident with  a  table  alone,  and  least  confident 
with  a  graph  alone.  However,  several  other  stud- 
ies have  found  no  effect  of  display  on  decision 
confidence  (Chervany  &  Dickson,  1974;  DeSanc- 
tis  &  Jarvenpaa,  1985;  Schroeder  &  Benbasat, 
1975;  Zmud,  Blocher,  &  Moffie,  1983).  Although 
there  are  many  possible  explanations  for  these 
mixed  results,  they  do  illustrate  an  important 
point:  Several  of  these  studies  did  find  that 
actual  level  of  performance  (accuracy)  differed 
across  displays,  even  though  confidence  levels 
did  not.  Note  that:  (1)  confidence  levels  may, 
at  best,  be  only  weakly  related  to  actual  accu- 
racy, and  (2)  inappropriately  high  levels  of  con- 
fidence have  been  observed  across  a  variety  of 
settings  (e.g..  Chapman  &  Chapman,  1969;  Ein- 
horn  &  Hogarth,  1978;  Lichtenstein,  FischhofT, 
&  Phillips,  1982).  However,  since  we  hypothe- 
size that  strategy  selection  is  based  on  perceived 
rather  than  a<:tual  accuracy,  evidence  on  deci- 
sion confidence  provides  important  information 
not  available  from  accuracy  data  alone.  Thus, 
a  weak  relationship  between  display  variations 
and  decision  confidence  suggests  that  perceived 
accuracy  may  not  vary  much  across  displays  and 
may  therefore  be  less  important  than  perceived 
effort  in  strategy  selection. 

However,  decision  makers  are  not  oblivious  to 
changes  in  accuracy.  Interesting  indirect  evi- 
dence is  provided  by  two  experiments  that  in- 
vestigated display  formats  for  nutritional  infor- 
mation in  supermarkets  (Russo,  Staelin,  Nolan, 
Russell,  k  Metcalf,  1986).  One  experiment  var- 
ied the  format  and  organization  of  information 
on  the  levels  of  positive  nutrients  (e.g.,  vitamins 
and  minerals)  contained  in  various  food  prod- 
ucts. In  particular,  several  displays  were  specif- 
ically intended  to  reduce  the  effort  required  to 
search  for  and  process  this  information.  The  re- 
searchers hypothesized  that  these  displays  would 
lead  to  greater  use  of  nutritional  information  and 
a  shift  in  purchase  behavior  toward  more  nutri- 
tious products.  While  consumers  did  appear  to 


read  and  process  these  displays,  there  were  no 
changes  in  purchase  behavior.  The  second  exper- 
iment attempted  a  similar  display  manipulation 
with  a  negative  nutrient,  the  amount  of  sugar 
contained  in  the  product.  In  this  case,  there  was 
a  significant  shift  toward  purchase  of  foods  with 
lower  sugar  content.  The  authors  argue  that  the 
difference  between  the  two  studies  was  that  the 
perceived  benefit  of  increasing  levels  of  positive 
nutrients  was  less  than  the  perceived  benefits  of 
reducing  negative  nutrients.  Display  manipula- 
tions intended  to  reduce  effort  may  only  be  ef- 
fective if  the  perceived  benefits  of  using  the  in- 
formation are  significant. 

To  summarize,  research  on  display  preferences 
and  decision  confidence  suggest  that  display  op- 
tions can  affect  perceived  effort  and  perceived 
accuracy.  Further  research  that  directly  mea- 
sures anticipated  effort  and  accuracy  is  needed 
to  delineate  the  relationship  between  display  op- 
tions and  anticipated  cognitive  incentives. 

3.2      Experienced  Effort  and  Accuracy 

If  decision  makers  are  considering  anticipated  ef- 
fort and  accuracy,  and  display  options  do  shift 
these  cognitive  incentives,  then  one  might  also 
expect  corresponding  effects  on  experienced  ef- 
fort and  accuracy.  This  would  show  up  in  the 
form  of  a  speed-accuracy  relationship:  For  ex- 
ample, when  a  display  is  changed,  a  decrease 
in  the  time  taken  to  complete  a  task  might  in- 
dicate either  a  shift  to  a  less  effortful  strategy 
or  a  speed-up  of  the  same  strategy.  Similarly, 
an  increase  in  performance  when  the  display  is 
changed  may  reflect  either  shifts  to  more  accu- 
rate strategies  or  fewer  errors  in  the  execution 
of  the  same  strategy.  In  this  section  we  discuss 
studies  that  address  the  effects  of  display  options 
on  both  decision  time  and  on  performance.  Most 
of  these  studies  required  subjects  to  perform  rel- 
atively simple  tasks  (e.g.,  point  reading,  compar- 
ison, proportion  judgments,  pattern  recognition, 
interpolation)  that  are  used  as  substrategies  in 
more  complex  tasks.  As  discussed  in  section  2.2, 
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it  is  the  aggregate  effect  of  display  options  on 
these  simple  tasks  that  will  influence  strategy 
selection  in  more  complex  tasks. 

Studies  of  the  eflfects  of  display  on  speed  and 
performance  have  produced  two  main  patterns 
of  results.  The  first  pattern  is  that  display  sig- 
nificantly affects  speed  but  has  relatively  little 
effect  on  performance.  Schutz  (1961b)  stud- 
ied the  effects  of  presenting  multiple  time  series 
on  separate  or  on  superimposed  graphs.  When 
asked  to  compare  trends,  subjects  showed  little 
variation  in  accuracy  but  took  less  time  when 
given  the  superimposed  graphs.  In  an  inter- 
polation task,  Carter  (1947)  found  no  accuracy 
differences  for  tables  versus  graphs,  but  found 
that  interpolations  were  significantly  faster  with 
graphs.  Vessey  and  Galletta  (1988)  found  that 
graphs  took  substantially  less  time  than  tables 
in  a  comparison  task,  but  were  also  slightly  less 
accurate.  Finally,  in  a  more  complex  task,  di- 
agnosing trouble  on  phone  lines,  Tullis  (1981) 
found  that  a  narrative  text  format  took  longer 
than  tables,  which  in  turn  took  longer  that  ei- 
ther monochrome  or  color  graphics  (although  ta- 
bles were  as  fast  as  graphs  with  practice),  but 
again  found  no  performance  differences  among 
formats.  It  should  be  noted  that  absolute  per- 
formance levels  were  high  in  aU  of  these  studies. 
This  supports  the  notion  that  in  relatively  easy 
tasks,  decision  makers  will  shift  to  easier  but  still 
accurate  strategies. 

The  second  pattern  of  results  shows  one  dis- 
play to  be  better  on  both  speed  and  accuracy. 
Two  studies  found  that  tables  were  better  than 
graphs  on  both  speed  and  performance  for  point 
reading  tasks  (Carter,  1947;  Vessey  &  Galletta, 
1988).  Schutz  (1961a)  found  that  in  a  pattern 
recognition  task,  line  graphs  were  best  on  both 
speed  and  performance,  while  vertical  bar  graphs 
were  second  on  both  criteria,  and  horizontal  bar 
graphs  were  worst  on  both.  Simkin  and  Hastie 
(1987)  also  found  that  for  each  of  two  simple 
tasks,  proportion  judgments  and  comparisons, 
the  type  of  graphical  display  that  produced  the 


best  performance  was  also  the  fastest.  Thus,  for 
many  simple  operations  there  appear  to  be  cer- 
tain display  types  that  dominate  others  on  both 
effort  and  accuracy,  an  idea  that  has  been  sug- 
gested elsewhere  (e.g.,  Benbasat  et  al.,  1986b; 
DeSanctis,  1984;  Jarvenpaa  &  Dickson,  1988; 
Vessey,  1988). 

One  series  of  studies,  using  a  more  com- 
plex task,  have  obtained  both  result  patterns. 
Benbasat  and  colleagues  used  a  budget  alloca- 
tion task  to  investigate  the  effects  of  graphi- 
cal and  color-enhanced  information  presentation 
formats  on  decision  time  and  performance  (Ben- 
basat &  Dexter,  1985,  1986;  Benbasat,  Dex- 
ter, Sz  Todd,  1986a,  1986b).  The  authors  sug- 
gest that  this  task  can  be  decomposed  into  dis- 
crete phases  and  that  effective  strategies  for 
each  phase  are  best  supported  by  different  dis- 
play types.  Specifically,  they  argue  that  the 
early  stages  require  qualitative  judgments  of  rel- 
ative trends  and  slopes  and  that  graphs  are 
more  appropriate  than  tables.  However,  later 
in  the  task,  when  precise  quantitative  responses 
are  required,  they  argue  tables  are  more  appro- 
priate than  graphs,  since  exact  numerical  val- 
ues can  be  obtained  both  easily  and  accurately. 
This  reasoning  implies  that  a  combined  tabular- 
graphical  display  might  be  better  than  either 
alone,  since  the  decision  maker  could  use  the  ap- 
propriate format  for  a  given  stage  of  the  prob- 
lem. One  study  did  find  a  combined  format  to 
be  both  the  fastest  and  the  most  accurate  (Ben- 
basat et  al.,  1986a). 

To  summarize,  results  on  speed  and  accu- 
racy show  a  clear  influence  from  display  vari- 
ations. Although  these  results  are  consistent 
with  our  cognitive  incentives  argument,  time 
and  performance  measures  alone  cannot  distin- 
guish between  effects  due  to  strategy-  shifts  ver- 
sus changes  in  the  speed  or  effectiveness  of  the 
same  strategy.  Furthermore,  since  most  of  these 
studies  used  very  simple  tasks,  it  remains  to  be 
seen  whether  similar  speed-accuracy  results  hold 
in  more  complex  tasks.   In  the  next  section,  we 
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examine  studies  that  use  more  complex  tasks 
and  collect  direct  measures  of  decision  strategies. 

3.3     Strategy  Selection 

The  studies  reviewed  in  this  section  use  process 
tracing  methods  (protocol  analysis  and  informa- 
tion search  patterns)  to  infer  which  strategies  are 
being  used  (Payne,  Braunstein,  &  Carroll,  1978; 
Todd  &  Benbasat,  1987).  This  research  has  ob- 
served strategy  selection  across  three  categories 
of  display  manipulations:  (1)  simultaneous  ver- 
sus sequential  displays  of  information,  (2)  vari- 
ations in  the  relative  proximity  of  information 
on  a  single  display,  and  (3)  the  use  of  quanti- 
tative versus  qualitative  representations  of  in- 
formation. Most  of  these  studies  use  a  multi- 
attribute  choice  task,  in  which  decision  makers 
select  the  best  of  several  alternatives,  each  of 
which  is  characterized  on  multiple  attributes. 

One  set  of  studies  observed  choice  behavior 
in  tasks  where  information,  displayed  in  book- 
lets or  on  loose  sheets  of  paper,  was  presented 
sequentially  by  attribute,  sequentially  by  alter- 
native, or  simultaneously  (Bettman  &  Kakkar, 
1977;  Bettman  &  Zins,  1979;  Jarvenpaa,  1989). 
Each  page  presented  the  values  of  all  attributes 
for  one  alternative,  the  values  of  all  alterna- 
tives for  one  attribute,  or  a  grouped  presen- 
tation containing  all  the  alternatives  and  their 
attribute  values.  Bettman  and  colleagues  used 
tabular  displays  of  numeric  data,  while  Jarven- 
paa used  bar  graphs.  When  sequential  dis- 
plays were  organized  by  alternative  (making  op- 
erations across  alternatives  inconvenient),  sub- 
jects tended  to  use  alternative-oriented  strate- 
gies such  as  the  weighted  additive  and  conjunc- 
tive rules.  In  contrast,  when  sequential  dis- 
plays were  organized  by  attribute  (making  oper- 
ations within  an  alternative  inconvenient),  sub- 
jects tended  to  use  attribute-oriented  strategies 
such  as  the  elimination-by-aspects  and  additive 
difference  rules.  In  the  grouped  data  presenta- 
tions, both  types  of  strategies  were  used,  but 
with  differing  conclusions  in  the  three  studies 


about  which  type  of  strategy  predominates. 

An  appealing  interpretation  of  the  results  of 
these  three  studies  is  based  on  cognitive  in- 
centives: Attribute-based  presentations  encour- 
age attribute-based  operations,  since  obtaining 
and  working  with  information  presented  on  the 
same  page  is  easier  than  when  it  is  on  differ- 
ent pages  (particularly  when  pages  are  arranged 
in  booklets  that  prevent  holding  two  pages  side- 
by-side).  Similarly,  alternative-based  presen- 
tations encourage  alternative-based  operations, 
while  grouped  presentations  seem  to  be  rela- 
tively neutral,  so  that  direction  of  processing  is 
left  to  the  preferences  and  predilections  of  the 
decision  maker.  Significantly,  field  studies  have 
observed  display-induced  changes  in  consumer 
choices  that  are  consistent  with  strategy  shifts 
of  this  type  (Russo,  1977;  Russo,  Krieser,  & 
Miyashita,  1975;  Russo  et  al.,  1986). 

Other  studies  have  examined  variations  in  the 
organization  of  a  single  display,  especially  the 
physical  proximity  of  items  of  information  on  the 
display.  Russo  and  Rosen  (1975)  observed  strong 
proximity  effects  in  an  analysis  of  eye  movements 
in  a  choice  task.  Although  only  47%  of  possi- 
ble pairs  of  alternatives  were  spatially  adjacent, 
63%  of  all  paired  comparisons  between  alterna- 
tives and  73%)  of  all  sequential  search  operations 
were  between  adjacent  alternatives,  results  that 
the  authors  attributed  to  ease  of  processing  con- 
siderations. Engineering  psychologists  have  also 
emphasized  the  importance  of  spatial  proximity 
of  information  in  the  design  of  instrument  dis- 
plays (e.g.,  Wickens,  1987).  Spatial  proximity 
induces  the  use  of  simple  strategies  for  scanning 
information  displays:  For  instance,  lists  tend  to 
be  scanned  from  start  to  finish,  while  matrix 
displays  tend  to  be  scanned  starting  in  the  up- 
per left-hand  corner  and  proceeding  along  rows 
or  columns  (Bettman  &  Kakkar,  1977;  Russo  & 
Rosen,  1975).  This  tendency  to  scan  in  the  order 
in  which  the  information  is  presented  is  impor- 
tant since  decision  makers  have  been  shown  to 
assign  greater  weight  to  information  that  is  pre- 
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sented  either  at  the  beginning  or  the  end  of  a 
sequence  (i.e.,  primacy  and  recency,  see  N.  An- 
derson, 1981;  Einhorn  k  Hogarth,  1985). 

A  final  set  of  studies  have  dealt  with  the  use 
of  quantitative  versus  qualitative  representations 
of  information.  Qualitative  information  forms 
(e.g.,  words  or  pictures)  can  increase  the  ef- 
fort required  to  use  strategies  that  require  nu- 
meric calculations.  Since  these  representations 
do  not  present  explicit  numeric  values,  these  val- 
ues must  be  obtained  through  an  effortful  pro- 
cess of  translation  or  estimation  prior  to  com- 
putation (Larkin  L  Simon,  1987).  For  exam- 
ple, consider  how  one  might  compute  the  dif- 
ference between  attribute  values  represented  as 
"fair"  and  "excellent".  In  two  experiments  using 
choice  tasks  in  which  information  was  presented 
using  either  numbers  or  words,  decision  makers 
were  observed  to  shift  their  decision  strategies 
to  avoid  expenditures  of  effort:  Huber  (1980) 
found  that  operations  within  an  attribute  (such 
as  finding  the  alternative  with  the  maximum 
value  on  a  specific  attribute)  were  more  fre- 
quent when  attribute  values  were  represented  by 
words.  Stone  and  Schkade  (1989)  found  that 
when  values  were  represented  by  words,  deci- 
sion makers  used  significantly  fewer  search  and 
combination  operations  within  attributes  than 
they  did  when  presented  with  numeric  values. 
In  two  judgment  tasks,  assigning  ratings  and  set- 
ting selhng  prices  for  gambles,  Johnson,  Payne, 
and  Bettman  (1988)  found  that  decision  mak- 
ers were  less  likely  to  select  strategies  that  used 
numeric  computations  when  probabilities  were 
presented  as  complicated  fractions  rather  than 
as  simple  decimals.  They  explained  this  strat- 
egy shift  in  terms  of  the  relative  ease  of  compu- 
tations with  simple  decimals.  Surprisingly,  al- 
though many  studies  have  used  a  mix  of  quanti- 
tative and  qualitative  information  in  the  same 
task  (e.g.,  Bettman  k  Kakkar,  1977;  Payne, 
1976),  there  have  been  no  systematic  studies  of 
the  effects  of  mixing  these  forms  (but  see  Tver- 
sky,  1969,  for  a  discussion  of  this  issue). 


Another  interpretation  of  the  studies  compar- 
ing quantitative  and  qualitative  representations 
is  that  some  operations  are  prohibitively  difficult 
to  execute  when  information  is  presented  in  cer- 
tain forms.  As  noted  in  the  discussion  of  Work- 
ing Assumption  4,  some  displays  preclude  the 
use  of  strategies  that  employ  these  operations. 
For  example,  Simkin  and  Hastie  (1987)  argue 
when  information  is  presented  in  graphs,  deci- 
sion makers  may  select  strategies  that  employ 
operations  that  are  not  well-defined  for  words 
or  numbers  (e.g.,  a  "projection"  operation  that 
mentally  extends  a  line  segment).  Similarly,  it 
may  actually  be  impossible  to  "multiply"  two 
words.  If  there  are  important  differences  in  the 
sets  of  basic  operations  that  are  meaningful  for 
various  display  types,  then  the  set  of  available 
strategies  wiU  also  change.  If  a  desired  strategy 
is  not  available,  a  decision  maker's  only  recourse 
would  be  to  either  perform  an  effortful  transla- 
tion of  the  information  into  a  compatible  form 
or  to  select  a  different  strategy'.  This  may  pro- 
vide an  alternative  explanation  for  results  of  the 
words  versus  numbers  studies  cited  above,  and 
is  an  issue  that  deserves  attention  in  future  re- 
search (e.g.,  in  studies  of  tables  versus  graphs). 

All  of  the  studies  cited  in  this  subsection  used 
process-tracing  methods.  Process  tracing  data 
is  particularly  useful  because  it  provides  a  more 
direct  measure  of  information  processing  strate- 
gies than  is  possible  when  only  measuring  deci- 
sion time  or  decision  quality.  As  was  the  case 
with  the  other  sets  of  studies,  the  evidence  from 
these  process  tracing  studies  is  consistent  with 
the  notion  that  decision  makers  respond  adap- 
tively,  selecting  strategies  in  response  to  the  cog- 
nitive incentives  induced  by  the  display.  Taken 
as  a  whole,  we  believe  that  the  evidence  dis- 
cussed above  is  strong  enough  to  warrant  pur- 
suing the  effort-accuracy  approach  further.  On 
the  other  hand,  we  do  not  wish  to  overstate  the 
strength  of  this  evidence,  since  these  studies  are 
relatively  few  in  number  and  consider  only  a  hm- 
ited  set  of  display  options.  The  next  section  out- 
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lines  what  needs  to  be  done  to  build  from  this 
staiting  point. 

4      Implications 

Our  discussion  raises  a  number  of  issues  for  re- 
searchers concerned  with  information  displays  in 
decision  support.  We  first  address  methodolog- 
ical issues  related  to  (1)  dependent  variables  in 
information  display  experiments,  (2)  the  use  of 
simulation  methods,  and  (3)  outlines  of  possible 
experimented  designs.  Finally,  we  discuss  pos- 
sible extensions  of  the  cost-benefit  approach  to 
other  aspects  of  decision  support  systems. 

4.1      Methodological  Issues 

Experiments  concerned  with  computer-based  de- 
cision support  need  to  move  beyond  simply 
measuring  whether  or  not  a  decision  aid  in- 
fluences decision  outcomes  and  toward  designs 
that  allow  researchers  to  ask  questions  about 
how  and  why  decision  aids  influence  outcomes 
(Todd  &:  Benbasat,  1987).  This  implies  that  re- 
searchers should  design  experiments  that  include 
dependent  variables  intended  to  measure  strat- 
egy selection  and  effort  in  addition  to  the  stan- 
dard measures  of  decision  quality  or  accuracy. 
These  measures  can  be  obtained  using  process- 
tracing  methods  like  verbal  protocols,  informa- 
tion search  records,  and  decision  time  (John- 
son, Payne,  Schkade.  k  Bettman.  1988;  Payne 
et  al.,  1978;  Russo,  1978).  Protocols  and  search 
records  can  be  coded  and  analyzed  in  order  to 
make  inferences  about  the  strategies  used  by 
decision  makers.  Total  decision  time  provides 
one  overall  measure  of  experienced  effort,  and 
more  detailed  timing  data  can  be  used  to  an- 
alyze the  effort  associated  with  basic  cognitive 
operations  or  substrategies  (Chase,  1978;  Pos- 
ner  &  McLeod,  1982).  To  illustrate,  Payne  and 
colleagues  (1988)  used  the  following  dependent 
variables  to  make  inferences  about  strategies  in 
a  risky  choice  task:  amount  of  information  ac- 
quired, average  time  spent  per  acquisition,  pro- 


portion of  acquisition  time  devoted  to  the  most 
important  attribute,  proportion  of  time  spent 
on  probability  rather  than  payoff  information, 
variances  of  several  of  the  previously  mentioned 
measures,  and  various  codings  of  the  sequential 
pattern  of  information  search.  A  more  detailed 
discussion  of  coding  and  analyzing  process  trac- 
ing data  can  be  found  elsewhere  (Carroll  &  John- 
son, 1989;  Ericsson  &  Simon,  1984). 

Our  discussion  has  emphasized  that  there  are 
some  important  variables  that  mediate  the  re- 
lationship between  display  options  and  decision 
outcomes — decision  makers  anticipate  the  effort 
and  accuracy  of  different  strategies  and  adap- 
tively  select  an  efficient  strategy  for  the  task  and 
display  at  hand.  To  test  this  relationship,  dis- 
play experiments  should  ideally  measure  aU  of 
the  following  dependent  variables:  (1)  Antici- 
pated effort  and  accuracy,  either  elicited  directly 
from  decision  makers  or  indirectly  from  measures 
like  display  preferences  or  decision  confidence; 

(2)  strategy,  obtained  from  process-tracing  data; 

(3)  effort-related  measures  like  decision  time; 
and  (4)  decision  quality  or  accuracy. 

Recent  developments  in  use  of  computer  sim- 
ulation techniques  may  prove  to  be  helpful  in 
developing  and  operationafizing  the  cost-benefit 
approach  to  strategy  selection.  Johnson  and 
Payne  (1985)  proposed  a  method  for  measuring 
the  effort  associated  with  decision  strategies  by 
decomposing  strategies  into  a  sequence  of  com- 
ponent processes,  called  elementary  information 
processes  (EIPs).  These  components,  which  are 
similar  to  the  simple  substrategies  discussed  ear- 
lier, are  basic  cognitive  operations  thought  to 
be  common  to  a  wide  variety  of  tasks  (Chase, 
1978;  Newell  &  Simon,  1972).  Examples  include 
reading  an  item  of  information  into  short-term 
memory,  adding  two  numeric  items  together,  or 
comparing  two  items.  Once  a  set  of  decision 
strategies  is  decomposed  into  a  common  set  of 
EIPs,  Monte-Carlo  simulation  techniques  can  be 
used  to  observe  the  choice  made  by  each  strat- 
egy over  a  large  number  of  decisions  while  also 
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counting  the  number  of  times  each  component 
operation  is  executed.  A  general  measure  of  ef- 
fort can  be  calculated  from  the  total  number  of 
component  operations  required  to  execute  a  par- 
ticular strategy  in  a  particular  task.  Total  deci- 
sion time  can  also  be  predicted  either  with  this 
measure  or  with  a  slightly  refined  measure,  mul- 
tiplying the  number  of  times  each  EIP  is  used 
by  an  estimate  of  the  time  required  to  execute 
that  EIP.  This  approach  has  been  used  to  predict 
total  decision  time  of  subjects  in  a  choice  task 
(Bettman  et  al.,  in  press)  and  task  completion 
times  in  experiments  involving  other  cognitive 
tasks  (Card,  Moran,  &  Newell,  1983;  Carpenter 
&  Just,  1975). 

This  simulation  approach  is  valuable  for  sev- 
eral reasons:  (1)  Simulations  incorporating  com- 
ponential  analyses  of  this  type  permit  a  vari- 
ety of  decision  strategies  to  be  investigated  over 
many  variations  in  task  characteristics.  Simu- 
lation experiments  that  systematically  vary  dis- 
play options,  task  characteristics,  and  strategies 
are  capable  of  exploring  the  complex  interactions 
among  these  factors.  (2)  Developing  the  simula- 
tions requires  the  researcher  to  specify  the  task 
environment  and  the  decision  strategies  in  great 
detail.  This  can  help  to  uncover  hidden  assump- 
tions and  gaps  in  knowledge  that  might  other- 
wise go  unnoticed.  (3)  Results  from  simulations 
can  be  used  to  predict  the  efficient  set  of  strate- 
gies for  a  particular  display  in  a  particular  task 
and  to  provide  quantitative  predictions  of  both 
effort  and  accuracy  (e.g.,  Kleinmuntz  &  Schkade, 
1989).  These  predictions  can  be  directly  com- 
pared to  the  results  of  experiments:  Do  decision 
makers  actually  select  strategies  that  the  simu- 
lation identifies  as  efficient?  Do  measures  of  de- 
cision time  and  decision  quality  agree  with  the 
simulation's  estimates  of  effort  and  accuracy? 
Thus,  the  simulations  provide  predictions  that 
place  the  theory  at  risk  of  disconfirmation,  an 
important  component  of  cumulative  theory  de- 
velopment (Meehl,  1978). 

Using  the  simulation  approach  generally  re- 


quires the  following  four  steps:  (1)  formally  de- 
scribe the  task  environment  (e.g.,  specification 
of  goals,  constraints,  problem  structure,  require- 
ments for  a  solution,  and  so  on);  (2)  characterize 
the  set  of  available  strategies  (e.g.,  identify  criti- 
cal stages  or  subtasks  and  describe  potential  so- 
lutions for  each);  (3)  describe  each  strategy  as 
an  organized  sequence  of  elementary  operations 
(e.g.,  a  production  system;  Newell  &  Simon, 
1972);  and  (4)  analyze  the  impact  of  displays 
on  elementary  operations  and  use  the  strategy 
descriptions  to  determine  the  aggregate  impact 
on  each  strategy  (e.g.,  operationalize  the  strate- 
gies as  computer  programs  and  use  Monte  Carlo 
techniques).  Note  that  these  steps  can  be  accom- 
plished without  formal  simulation  methods:  In 
our  examples  in  section  2.2,  as  in  most  previous 
cognitive  cost-benefit  studies,  we  derived  quali- 
tative predictions  about  the  direction  of  display 
efi"ects  through  an  informal  mental  simulation. 
While  the  mental  simulation  approach  has  the 
practical  advantage  of  being  easy  to  implement, 
it  lacks  the  quantitative  precision  of  formal  simu- 
lation methods  and  may  fail  to  detect  important 
interactions  between  display  and  task  character- 
istics (see  Payne  et  al.,  1988,  for  an  illustration 
of  the  advantages  of  the  formal  approach). 

Ideally,  research  on  displays  in  decision  sup- 
port should  lead  to  generalizations  about  the 
influence  of  display  options  on  strategy  selec- 
tion across  a  variety  of  tasks.  Even  at  this 
preliminary  stage,  the  discussion  above  suggests 
some  examples  of  research  propositions  that  war- 
rant further  investigation  (listed  in  Table  2). 
Experiments  designed  to  test  propositions  of 
this  type  would  be  considerably  strengthened  if 
(1)  the  independent  variables  include  task  char- 
acteristics other  than  the  information  display, 
and  (2)  information  display  options  are  manip- 
ulated as  within-subject  variables.  Varying  ad- 
ditional task  characteristics  (e.g.,  problem  size, 
response  mode,  similarity  of  alternatives,  pres- 
ence of  dominated  alternatives)  can  help  to  ac- 
count for  seemingly  conflicting  results  in  previ- 
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Table  2:  Examples  of  Research  Propositions 

•  Proposition  1:  Verbal  and  pictorial  display  forms  discourage  the  use  of  strategies  that  require 
numerical  calculations. 

•  Proposition  2:  Decision  makers  tend  to  avoid  strategies  that  require  combining  items  of  infor- 
mation with  different  forms. 

•  Proposition  3:  Decision  makers  tend  to  choose  strategies  that  use  items  of  information  that 
are  in  close  physical  proximity  on  the  display. 

•  Proposition  4:  Decision  makers  tend  to  choose  strategies  that  use  items  of  information  that 
have  similar  display  features. 

•  Proposition  5:  Expert  decision  makers  are  more  knowledgeable  about  available  strategies  and 
will  exhibit  greater  adaptability  to  variations  in  display  design. 


ous  studies.  For  instance,  suppose  a  particular 
display  manipulation  has  a  large  impact  on  de- 
cision strategies  only  when  the  problem  is  large. 
The  only  way  to  verify  this  is  to  manipulate 
both  problem  size  and  display  in  the  same  exper- 
iment. This  type  of  comparison  is  enhanced  by 
the  use  of  within-subject  designs  in  which  a  de- 
cision maker  is  presented  with  different  displays 
of  the  same  problems  (e.g..  Stone  &  Schkade, 
1989).  One  advantage  of  this  type  of  design 
is  statistical  power,  which  can  help  to  compen- 
sate for  the  fact  that  the  effort  required  for  data 
coding  can  limit  the  number  of  subjects  used  in 
process-tracing  studies. 


4.2      Extensions  to  Other  System  Fea- 
tures 

Our  discussion  has  been  based  on  a  simplify- 
ing assumption  that  warrants  further  discussion: 
Specifically,  we  have  assumed  that  display  op- 
tions do  not  affect  other  characteristics  of  the 
task.  However,  decision  support  systems  are 
capable  of  modifying  not  only  the  display  of  a 
problem,  but  the  underlying  structure  as  well. 
These  modifications  could  include  adding  vari- 
ables (e.g.,   new  information   retrieved   from  a 


database  or  summary  measures  computed  from 
other  variables),  removing  variables  (e.g.,  screen- 
ing out  redundant  or  irrelevant  information), 
adding  decision  alternatives  (e.g.,  searching  re- 
mote databases  to  find  new  options),  and  remov- 
ing alternatives  (e.g.,  screening  out  options  that 
are  clearly  inferior).  In  more  complex  tasks,  a 
wide  variety  of  model- based  or  knowledge-based 
inferences,  predictions,  and  evaluations  are  pos- 
sible (for  an  overview,  see  Zachary,  1986). 

The  effort-accuracy  approach  can  be  readily 
extended  to  these  system  features.  For  instance, 
if  the  computer  performs  operations  that  might 
otherwise  be  left  to  the  decision  maker,  com- 
putationally intensive  strategies  become  cogni- 
tively  less  costly,  and  the  decision  maker  has 
less  incentive  to  avoid  them.  Similarly,  trans- 
ferring computational  operations  to  the  system 
may  reduce  the  number  of  errors,  since  the  com- 
puter performs  with  greater  consistency  (Bow- 
man, 1963;  Dawes,  1979).  However,  it  seems 
likely  that  factors  other  than  effort  and  accu- 
racy will  need  to  be  included  in  these  cost- 
benefit  trade-offs.  For  example,  although  pro- 
viding summary  measures  might  potentially  in- 
crease accuracy  and  decrease  effort,  decision 
makers  may  reject  them  if  they  lack  credibility 
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and  acceptance  (Russo  et  al.,  1986).  Credibil- 
ity issues  may  be  even  more  pronounced  when 
more  sophisticated  system  capabilities  are  con- 
sidered (e.g.,  model-  or  knowledge- based  infer- 
ences; also  see  Fischhoff,  1980;  Kleinmuntz,  in 
press).  While  effort  and  accuracy  are  important 
determinants  of  decision  behavior,  they  are  not 
the  only  important  factors. 

On  the  other  hand,  treating  the  decision 
maker's  cognitive  strategy  as  a  variable  that  me- 
diates the  relationship  between  system  features 
and  system  effectiveness  is  a  general  approach 
that  may  prove  to  be  useful.  For  instance,  in 
a  recent  study,  Todd  and  Benbasat  (1989)  use 
the  cost-benefit  approach  to  successfully  predict 
the  impact  of  decision  aids  on  decision  strate- 
gies. Of  particular  interest  was  an  experiment 
in  which  they  influenced  strategy  selection  by 
selectively  adding  certain  capabilities  to  a  de- 
cision support  tool:  When  provided  with  tools 
that  explicitly  reduced  the  effort  required  to  use 
a  particular  substrategy,  decision  makers  were 
observed  to  shift  toward  use  of  strategies  that 
relied  upon  that  substrategy.  These  results  sup- 
port the  cost-benefit  approach  in  general  as  well 
as  the  specific  focus  on  cognitive  effort  in  strat- 
egy selection. 

An  interesting  issue  in  designing  decision  sup- 
port systems  is  whether  the  decision  maker 
should  be  given  control  over  the  choice  of  display 
or  other  system  features  (Sprague  k  Carlson, 
1982,  chapter  5;  also  see  Silver,  1988a,  1988b). 
A  system  can  provide  varying  degrees  of  flexi- 
bility to  the  decision  maker:  The  designer  could 
completely  predetermine  the  set  of  display  op- 
tions or  could  design  the  system  to  provide  ei- 
ther a  small  or  large  set  of  alternative  display  op- 
tions, thereby  permitting  the  decision  maker  to 
select  among  those  options  each  time  the  system 
is  used.  Flexibility  provides  the  decision  maker 
with  the  opportunity  to  actively  influence  the 
cognitive  incentives  created  by  the  task  and  the 
display.  For  example,  if  a  decision  maker  wishes 
to  use  a  particular  strategy,  then  a  display  that 


facilitates  that  strategy  can  be  selected.  While 
allowing  decision  makers  to  alter  the  display 
to  suit  their  own  preferences  seems  appealing, 
there  is  the  danger  that  the  decision  maker  will 
only  reinforce  bad  habits,  particularly  when  de- 
cision makers  suffer  from  misperceptions  about 
the  effort  and  accuracy  associated  with  different 
strategies. 

At  present,  empirical  evidence  relating  to  the 
impact  of  flexibility  on  decision  processes  is  ex- 
tremely limited.  Dos  Santos  and  Bariff  (1988) 
found  better  performance  when  a  system  pro- 
vided guidance  in  use  of  models,  but  did  not 
collect  any  process  data.  There  has  been  some 
research  on  a  particular  aspect  of  flexibility,  the 
use  of  agendas  in  decision  making.  Results  sug- 
gest that  considering  decision-relevant  informa- 
tion in  a  constrained  order  can  strongly  influ- 
ence the  decision  process  (Hauser,  1986;  Hul- 
land,  1988;  Plott  k  Levine,  1978;  Tversky  t 
Sattath,  1979).  Thus,  restricting  the  sequence  in 
which  information  is  presented  on  displays  can 
have  an  impact  on  strategy  selection.  Further  re- 
search on  strategy  selection  in  a  variety  of  com- 
plex tasks  will  lead  to  a  better  understanding  of 
the  implications  of  allocating  flexibility  to  the 
decision  maker. 

4.3     Conclusion 

System  designers  need  guidelines  to  inform  them 
about  how  decision  makers  use  (or  choose  not 
to  use)  various  features  of  a  system.  Of  course, 
it  would  be  inappropriate  to  conclude  that  cur- 
rent display  designs  are  completely  insensitive  to 
user  needs  and  preferences.  An  interesting  pos- 
sibility is  that  future  research  will  reveal  that 
elements  of  current  designs  are  in  fact  quite  ap- 
propriate and  useful.  For  instance,  matrix-based 
information  displays  are  widely  used,  most  no- 
tably in  spreadsheet  software.  Proposition  3  in 
Table  2  suggests  that  matrix  displays  contain- 
ing large  amounts  of  information  may  be  prefer- 
able to  a  sequence  of  lists  that  each  present  lim- 
ited amounts  of  information.     This  is  because 
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the  availability  of  large  amounts  of  information 
in  close  physical  proximity  makes  a  number  of 
strategies  relatively  easy  to  execute,  increasing 
decision  makers'  ability  to  adapt.  Admittedly, 
very  little  of  the  empirical  work  supporting  this 
argument  has  looked  specifically  at  computer- 
based  displays.  However,  if  matrix-based  dis- 
plays prove  to  be  equally  effective  when  imple- 
mented on  computers  (a  likely  outcome),  then 
this  leads  to  a  recommendation  about  display 
design  that  is  not  too  surprising. 

On  the  other  hand,  given  the  confusing  and 
inconsistent  state  of  knowledge  about  a  number 
of  other  display  options,  it  seems  likely  that  a 
careful  program  of  research  will  uncover  recom- 
mendations that  are  both  surprising  and  useful. 
System  designers  routinely  make  implicit  trade- 
offs about  the  user's  cognitive  costs  and  benefits. 
Making  those  trade-offs  explicit  has  the  poten- 
tial to  improve  the  usefulness  of  computer-based 
decision  aids  and,  ultimately,  lead  to  more  effec- 
tive decision  making. 
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